Listing of Claims 



l.'-24. (Canceled) 

25. (Currently Amended) A conversational computing system, comprising: 

a multi-modal GUI (conversational user interface) manager, operatively connected to a 
plurality of I/O (input/output) renderers, which can receive input queries and input events across 
different user interface modalities of different active applications and generate output messages 
and output events in connection with the active applications in one or more of the different user 
interface modalities; 

a conversational kemel for generating multi-modal dialogs in response to the input 
queries and input events, and for managing context associated with the active applications; and 

a conversational API (application program interface) for providing an interface between 
the active applications and the conversational kemel; 

a plurality of I/O resources: and 

an I/O API for interfacing with the plurality of I/O resources and for registering the 
plurality of I/O resources with the conversational kemel . 

26. (Original) The system of claim 25, further comprising: 
a conversational engine API; and 

a plurality of conversational engines, wherein the conversational kemel controls and 
accesses the conversational engines through the conversational engine API to process the input 
queries and input events and to generate the multi-modal dialog and output events. 

27. (Original) The system of claim 25, wherein the conversational kernel provides 
conversational services and behaviors that are accessible by an application through the 
conversational API. 
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28. (Original) The system of claim 27, wherein the conversational services and behaviors 
comprise one of conversational security, conversational customization, conversational search, 
conversational selection, conversational help, conversational memorization, conversational 
summarization, conversational agents, conversational formatting, conversational prioritization, 
conversational re-direction, conversational categorization, conversational abstraction and object 
management, conversational navigation, conversational undo, and a combination thereof 

29. (Original) The system of claim 25, wherein the conversational API comprises a 
library comprising library functions of conversational foundation classes (CFCs) and 
fundamental dialog components, wherein the CFCs and fundamental dialog components are 
accessible through the library for constructing conversational objects, wherein the conversational 
objects are employed for one of performing conversational procedures and building 
conversational applications. 

30. (Original) The system of claim 29, wherein the CFCs can share context and be 
activated in parallel within an application or across a plurality of applications. 

31. (Original) The system of claim 30, wherein the CFCs and fundamental dialog 
components comprise one of CUI building blocks, conversational platform libraries, dialog 
modules, dialog scripts, beans, conversational gestures, and a combination thereof 

32. (Original) The system of claim 31, further comprising a conversational browser, 
wherein the CFCs, dialog components, CUI building blocks, conversational platform libraries, 
dialog modules, dialog scripts, beans, conversational gestures, and conversational API are loaded 
into the system through CML (conversational markup language) pages that are processed via the 
conversational browser. 

33. (Original) The system of claim 29, wherein the conversational objects are 
implemented one of declaratively, imperatively and a combination thereof 
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34. (Original) The system of claim 25, wherein the conversational kernel is a platform 
that executes on top of one of an operating system, a real-time operating system, a virtual 
machine and a browser. 

35. (Original) The system of claim 25, wherein the conversational kemel executes as an 
operating system service layer. 

36. (Original) The system of claim 25, wherein the system executes on one of a personal 
computer platform, a server platform, an embedded client device platform and a distributed 
combination of these platforms. 

37. (Canceled) 

38. (Currently Amended) The system of claim 25 wherein the conversational kemel 
comprises a conversational transcoder for providing adaptation of the behavior, CUI and dialog 
presented to a user based on capabilities of the I/O resources and conversational engines. 

39. (Currently Amended) The system of claim 25 wherein the I/O API layer 
comprises one of I/O abstractions, user interface abstractions, device abstractions and a 
combination thereof. 

40. (Original) The system of claim 26, wherein the conversational engines comprise 
NLU (natural language understanding) and NLG (natural language generation) engines, and 
wherein the multi-modal dialogs comprise NLU and NLG dialogs. 

41. (Original) The system of claim 40, wherein the conversational kemel provides 
support at the dialog management level for NL (natural language) and use of context for 
disambiguation and mixed initiative. 
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42. (Original) The system of claim 25, wherein the conversational kernel comprises: 
a dialog manager for managing dialog across active applications and for selecting an 

active dialog, context and application based on input queries; 

a resource manager for managing and allocating conversational engines that are used 
during execution of conversational tasks; 

a conversational task dispatcher for coordinating and dispatching conversational tasks; 

and 

a context stack for accumulating a context of an active discourse of a conversational task, 
the context comprising query arguments, a list of attribute value - uples and conversational state. 

43. (Original) The system of claim 42, wherein the context stack comprises a global 
history of context. 

44. (Original) The system of claim 42, wherein the context stack comprises a meta- 
information repository. 

45. (Original) The system of claim 44, wherein the meta-information repository 
comprises a-priori known information. 

46. (Original) The system of claim 44, further comprising a meta information manager 
for managing the meta-information repository, wherein the meta-information comprises a 
plurality of abstract categories associated with elements comprising one of files, directories, 
objects, data stream handles, networks, peripherals, hardware, applications, networked file 
systems and a combination thereof. 

47. (Original) The system of claim 46, wherein the meta-information is used to provide 
shortcuts to the elements. 
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48. (Original) The system of claim 46, wherein a user can navigate the categories of the 
meta- information through multi-modal conversational dialogs that comprise filling sets of 
attribute values out of a set of possible query types, and wherein the user can refine or modify the 
result of current navigation queries based on similarities of the corresponding categories. 

49. (Original) The system of claim 46, wherein the meta-information provides a-priori 
knowledge information for the categories of meta-information. 

50. (Original) The system of claim 44, wherein the meta-information comprises user 
meta- information representing one of user preferences, security, habits, biometrics, behavior and 
a combination thereof 

5 1 . (Original) The system of claim 50, wherein the user meta-information is one of 
provided directly by the user, learned firom past usage of the system by the user, and a 
combination thereof 

52. (Original) The system of claim 42, wherein the conversational kernel fiirther 
comprises a back- end abstraction layer for accessing back-end logic via the dialog manager. 

53. (Currently Amended) Th e syst e m of claim 25. further comprising A conversational 
computing svstem. comprising: 

a multi-modal GUI (conversational user interface) manager, operativelv connected to a 
plurality of I/O (input/output) renderers, which can receive input queries and input events across 
different user interface modalities of different active applications and generate output messages 
and output events in connection with the active applications in one or more of the different user 
interface modalities; 

a conversational kernel for generating multi-modal dialogs in response to the input 
queries and input events, and for managing context associated with the active applications; 
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a conversational API (application program interface) for providing an interface between 
the active applications and the conversational kernel; and 

a communication stack that implements conversational protocols for exchanging 
information with a conversationally aware system, wherein the conversationally aware system 
comprises one of a remote application, a remote device, a remote conversational computing 
system, and a combination thereof 

54. (Original) The system of claim 53, wherein the conversational protocols comprise 
distributed conversational protocols for exchanging information comprising one of 
conversational state, conversational arguments, context, conversational engine API calls, results, 
and a combination thereof 

55. (Original) The system of claim 53, wherein information exchanged between 
applications through the conversational protocols comprises a description of a conversational 
state of the applications, wherein the information representing a conversational state comprises 
one of a grammar, a vocabulary, acoustic models, language models, prompts, synthesis details, 
parsing details, tagging details, information to manage the dialog, and a combination thereof. 

56. (Original) The system of claim 53, wherein information exchanged through the 
conversational protocols comprises a modality-independent description of an interface of a 
remote control unit, wherein the interface allows the user to remotely control a conversationally 
aware appliance though the remote control unit. 

57. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational discovery protocols for automatically discovering the conversationally aware 
systems, and wherein the information exchanged through the conversational discovery protocols 
comprises broadcast requests for handshake, exchange of identifiers, exchange of handles for 
first registration and exchange of handles for first negotiation. 
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58. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational negotiation protocols for exchanging information to negotiate network topology 
between the system and a conversationally aware system. 

59. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational registration protocols for exchanging registering information, wherein the 
registering information comprises one of conversational capabilities, conversational state, 
context, and a combination thereof 

60. 96. (Canceled) 

97. (Currently Amended) A computer readable medium having stored thereon a set of 
instructions that are executable by a computer to implement a conversational virtual machine, the 
conversational virtual machine comprising: 

a kernel adapted to manage dialog and context, conversational engines and resources and 
communication across different platforms, applications, devices or combinations thereof, each 
having one or more different user interface modalities, to provide a coordinated, universal 
conversational user interface (CUI) across the different user interface modalities; ^id 

an API (application program interface) comprising abstractions adapted to access 
conversational services from the kemel on behalf of said platforms, applications, and devices or 
combinations thereof; 

a dialog manager adapted to manage conversational dialog across registered applications; 

and 

a context stack for maintaining the context of an active application or task under the 
control of the dialog manager . 
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98. (Previously Presented) The computer readable medium of claim 97, wherein the 
conversational virtual machine is a shell that executes on top of one of an operating system, a 
real-time operating system, a virtual machine, and a conversational browser. 

99. (Previously Presented) The computer readable medium of claim 97, wherein the 
conversational virtual machine executes as an operating system service layer. 

100. (Previously Presented) The computer readable medium of claim 97, further 
comprising an engine API comprising abstractions adapted to access a conversational engine. 

101. (Previously Presented) The computer readable medium of claim 97, wherein the 
API comprises a plurality of conversational foundation classes that are accessible through library 
functions for building one of conversationally aware applications, dialog components for 
performing specific reusable dialog tasks, and both. 

102. (Previously Presented) The computer readable medium of claim 101, wherein the 
conversational foundation classes comprise conversational gestures that characterize a modality- 
independent dialog. 

103. (Previously Presented) The computer readable medium of claim 97, wherein the 
conversationally aware applications and dialog components are implemented one of 
declaratively, imperatively, and a combination thereof 

104. (Previously Presented) The computer readable medium of claim 97, wherein the 
kemel comprises a task manager adapted to drive a conversational engine and a task, process or 
thread running on the conversational virtual machine. 

105. (Previously Presented) The computer readable medium of claim 97, wherein the 
kernel comprises: 
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a resource manager adapted to manage one of local resources, distributed resources, and 
both; and 

an input/output (I/O) manager adapted to manage multi-modal I/O events. 

106. (Canceled) 

107. (Currently Amended) The computer readable medium of claim 97 406, wherein the 
kernel further comprises an arbitrator for arbitrating a target application of an I/O event between 
the registered applications. 

108. (Currently Amended) The computer readable medium of claim 97 4-06, wherein the 
API comprises conversational protocols adapted to provide distribution of the conversational 
virtual machine. 

109. (Previously Presented) The computer readable medium of claim 108, wherein the 
distribution of the conversational virtual machine comprises distribution of functions and 
components of the conversational virtual machine across multiple devices or resources that 
collectively contribute to providing a complete functionality of the conversational virtual 
machine. 

110. (Previously Presented) The computer readable medium of claim 108, wherein the 
distribution of the conversational virtual machine comprises distribution of functions of the 
conversational virtual machine among a plurality of conversational virtual machines. 

111. (Previously Presented) The computer readable medium of claim 1 1 0, wherein the 
role of each of the plurality of conversational virtual machines is dynamically negotiated between 
the conversational virtual machines. 
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1 12. (Previously Presented) The computer readable medium of claim 108, wherein the 
distribution of the conversational virtual machine comprises distribution of the dialog manager 
and context stack across the registered applications. 

113. (Previously Presented) The computer readable medium of claim 108, wherein the 
conversational protocols comprise conversational distributed protocols adapted to allow 
coordination of a dialog among a plurality of apphcations and devices. 

1 14. (Previously Presented) The computer readable medium of claim 113, wherein the 
plurality of applications and devices comprise silent partners. 

115. (Previously Presented) The computer readable medium of claim 108, wherein the 
conversational protocols comprise negotiation protocols adapted to allow the kemel to 
dynamically negotiate one of a master/slave, a client/server, and a peer-to-peer topology with at 
least one kemel of a remote conversational virtual machine. 

116. (Canceled) 

117. (Previously Presented) The computer readable medium of claim 97, wherein the 
conversational virtual machine transcribes input events into ASCII input streams and processes 
the ASCII input streams as objects. 

118. (Previously Presented) The computer readable medium of claim 1 1 7, wherein the 
ASCII input streams comprise a list of attribute- value n-uples. 

119. (Currently Amended) Th e comput e r r e adabl e m e dium of claim 97 A computer 
readable medium having stored thereon a set of instructions that are executable bv a computer to 
implement a conversational virtual machine, the conversational virtual machine comprising: 
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a kernel adapted to manage dialog and context, conversational engines and resources and 
communication across different platforms, applications, devices or combinations thereof, each 
having one or more different user interface modalities, to provide a coordinated, universal 
conversational user interface (CUD across the different user interface modalities: 

an API (application program interface) comprising abstractions adapted to access 
conversational services from the kernel on behalf of said platforms, applications, and devices or 
combinations thereof , 

wherein the conversational virtual machine compares dialogs with conversational logic. 

120. (Previously Presented) The computer readable medium of claim 119, wherein the 
conversational logic comprises logic statements including one of true, false, incomplete, 
ambiguous, different/equivalent for ASCII comparison, different/equivalent for NLU-converted 
query comparison, different/equivalent for active query field comparison, unknown, 
incompatible, incomparable, and a combination thereof. 

121. (Previously Presented) The computer readable medium of claim 97, wherein the 
conversational virtual machine is implemented as an interface for a UCRC (universal 
conversational remote control), wherein the UCRC is used to control home appliances that are 
conversationally aware. 

1 22. (Previously Presented) The computer readable medium of claim 121, wherein the 
UCRC comprises a speech- enabled PDA (personal digital assistant) device. 

123. -124. (Canceled) 

125. (New) A conversational computing system, comprising: 

a multi-modal CUI (conversational user interface) manager, operatively connected to a 
plurality of I/O (input/output) renderers, which can receive input queries and input events across 
different user interface modalities of different active applications and generate output messages 
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and output events in connection with the active applications in one or more of the different user 
interface modaUties; 

a conversational kernel for generating multi-modal dialogs in response to the input 
queries and input events, and for managing context associated with the active applications; md 

a conversational API (application program interface) for providing an interface between 
the active applications and the conversational kemel; 

wherein the conversational kemel comprises: 

a dialog manager for managing dialog across active applications and for selecting an 
active dialog, context and application based on input queries; 

a resource manager for managing and allocating conversational engines that are used 
during execution of conversational tasks; 

a conversational task dispatcher for coordinating and dispatching conversational tasks; 

and 

a context stack for accumulating a context of an active discourse of a conversational task, 
the context comprising query arguments, a list of attribute value - uples and conversational state. 

126. (New) The system of claim 125, wherein the context stack comprises a global 
history of context. 

127. (New) The system of claim 125, wherein the context stack comprises a meta- 
information repository. 

128. (New) The system of claim 127, wherein the meta-information repository 
comprises a-priori known information. 

129. (New) The system of claim 127, further comprising a meta information manager 
for managing the meta-information repository, wherein the meta-information comprises a 
plurality of abstract categories associated with elements comprising one of files, directories. 
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objects, data stream handles, networks, peripherals, hardware, applications, networked file 
systems and a combination thereof. 

130. (New) The system of claim 129, wherein the meta-information is used to provide 
shortcuts to the elements. 

131. (New) The system of claim 1 29, wherein a user can navigate the categories of the 
meta- information through multi-modal conversational dialogs that comprise filling sets of 
attribute values out of a set of possible query types, and wherein the user can refine or modify the 
result of current navigation queries based on similarities of the corresponding categories. 

132. (New) The system of claim 129, wherein the meta-information provides a-priori 
knowledge information for the categories of meta-information. 

133. (New) The system of claim 127, wherein the meta-information comprises user 
meta- information representing one of user preferences, security, habits, biometrics, behavior and 
a combination thereof 

134. (New) The system of claim 133, wherein the user meta-information is one of 
provided directly by the user, leamed fi'om past usage of the system by the user, and a 
combination thereof 

135. (New) The system of claim 125, wherein the conversational kernel fiirther 
comprises a back- end abstraction layer for accessing back-end logic via the dialog manager. 
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